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1.  Introduction 


Face  recognition  has  been  an  active  area  of  research  for  over  2  decades  due  its  wide 
range  of  applications.  The  focus  of  face  recognition  has  primarily  been  on  visible 
imagery  in  the  0.35-  to  0.74- pm  wavelength  range.  However,  the  military 
commonly  employs  thermal  imaging  systems,  which  operate  in  the  midwave  IR 
band  (MWIR;  3-5  pm)  and  longwave  IR  band  (LWIR;  8-14  pm),  for  nighttime 
operations.  Therefore,  it  would  be  beneficial  to  the  Army  to  be  able  to  exploit  the 
thermal  IR  bands  along  with  the  visible  band  for  face  recognition  applications,  such 
as  matching  a  given  thermal  face  image  acquired  at  nighttime  with  visible  light  face 
images  in  an  existing  database.  To  achieve  this  capability,  a  database  of 
simultaneously  acquired  thermal  and  visible  face  imagery  is  needed  to  support  the 
development  of  multimodal  face  recognition  algorithms  and  methods.1 

Previous  work  suggests  that  IR  face  images  may  be  less  sensitive  to  facial 
expression  changes  than  visible  band  face  images2  Other  work  has  focused  on 
improving  face  recognition  performance  with  respect  to  different  head  poses.  A 
relatively  new  development  in  face  recognition  is  exploiting  polarimetric  imaging 
sensors,  which  provide  information  related  to  the  surface  geometry  of  the  face  in 
addition  to  the  intensity  information.  This  additional  information  has  been 
demonstrated  to  improve  cross-modal  face  recognition  over  conventional  thermal 
imagery3 

2.  Sensor  Description 

The  data  collection  sensors  consisted  of  the  instruments  discussed  in  this  section 
and  Section  3.  They  were  mounted  to  a  single  optical  plate  and  were  oriented  so 
that  the  subject’s  face  was  in  the  field  of  view  (FOV)  for  all  the  sensors  for  most  of 
the  data  collection  distances  and  sensors’  FOVs. 

2.1  Imaging  Polarimeter 

The  primary  sensor  for  this  face  recognition  data  collection  was  the  640  LWIR 
multispectral  imaging  polarimeter  developed  by  Polaris  Sensor  Technologies,  Inc., 
called  the  VELA  LW  sensor  (Fig.  1).  This  instrument  has  a  6-position  filter  wheel, 
which  enables  it  to  operate  in  several  thermal  IR  spectral  bands.  For  this  data 
collection,  Filter  1  was  employed,  which  provided  a  spectral  band  of  7.5-1 1.1  pm. 
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Fig.  1  VELA  LW  sensor 

This  instrument  employs  a  rotating  half-wave  (A/2)  retarder.  Half-wave  retarders 
are  sometimes  called  polarization  rotators.  “The  half-wave  plate  can  be  used  to 
rotate  the  polarization  state  of  a  plane  polarized  light.”4  If  the  incoming  light  is 
linearly  polarized  and  a  half-wave  retarder  is  rotated  by  the  angle  (phi)  relative  to 
the  incoming  light,  the  output  will  be  linearly  polarized  at  an  angle  of  2*(phi) 
relative  the  incoming  light.  The  ideal  half-wave  retarder  would  have  a  retardance 
of  1 80°  and  would  be  stable  with  respect  to  wavelength,  temperature,  and  angle  of 
incidence.  The  retarder  used  in  this  instrument  is  a  custom  cadmium 
sulfide/cadmium  selenide  achromatic  retarder  fabricated  by  Gooch  and  Housego, 
Inc.  The  measured  retardance  (in  degrees)  of  this  optical  device  is  close  to  180°  and 
does  not  vary  greatly  over  the  operating  wavelengths,  as  shown  in  Fig.  2. 


Retardance  Achromatic  Retarder 


Fig.  2  Retardance  of  half-wave  (kl 2)  retarder 
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The  rotating  retarder  is  located  in  front  of  the  cooled  optics  containing  the  fixed 
wire-grid  polarizer  and  bandpass  fdter  wheel.  The  rotating  retarder  working  in 
conjunction  with  the  wire-grid  polarizer  results  in  changes  in  the  intensity  levels  on 
the  IR  focal-plane  array  (FPA).  These  intensity  changes  are  a  function  of  the  linear 
polarization  states  of  the  IR  light  radiated  from  the  surfaces  of  objects  in  the  FOV, 
such  as  a  human  face.  Rotating  retarder  type  imaging  polarimeters  can  suffer  from 
pixel-  and  subpixel-level  image  misregistration  between  successive  images.  It  is 
worst  for  the  sharp  edges  in  the  scene.  The  evidence  of  this  misregistration  is 
artificial  edge  enhancement.5  These  potential  data  quality  issues  did  not 
significantly  impact  our  study. 

The  VELA  LW  sensor  is  a  division-of-time  spinning  retarder  system.  The 
measurements  by  the  FPA  are  taken  sequentially  in  time.  Between  measurements, 
the  retarder  rotates  and  the  angle  of  the  linear  polarized  IR  light  that  is  passed  to 
the  FPA  changes.  “In  its  principle  mode  of  operation,  the  system  acquires  a  set  of 
16  images  per  rotation  of  the  A/2  retarder.  Images  are  captured  at  0°,  22.5°,  45°  . . . 
to  337. 5°. ”6 

The  basic  sensor  parameters  for  the  VELA  LW  are  as  follows: 


Format: 

640  x  480 

Waveband: 

7.5-11.1  pm 

Pixel  size: 

15  x  15  pm 

NEAT: 

25  mK  at  f/2 

Frame  rate: 

120  Hz 

Dynamic  range: 

14-bit 

Narrow  FOV: 

3.3°  x  2.5° 

Wide  FOV: 

10.6°  x  7.9° 

The  polarimetric  data  products  produced  by  this  sensor  are  shown  in  Table  1.  The 
Stokes  polarization  parameters,  So,  Si,  S2,  and  S3,  describe  the  polarization  state  of 
the  electromagnetic  field.  S3  is  a  measure  of  the  right-hand  circular  (RHC) 
polarization  minus  the  left-hand  circular  (LHC)  polarization.  For  this  sensor,  S3  is 
0,  because  the  wire  grid  polarizer  passes  only  linearly  polarized  light. 
RHC=LHC=0. 
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Table  1 

Polarimetric  data  products  produced  by  the  VELA  LW  sensor 

Image 

Description 

50  image 

51  image 

52  image 

Si/So  image 

S2/S0  image 

DOLP  image 

Total  radiance  image,  W/cm2-sr 

Horizontally  polarized  radiance  minus  vertically  polarized  radiance 

45°  polarized  radiance  minus  135°  polarized  radiance 

51  normalized  radiance  image  So 

52  image  normalized  by  radiance  image  So 

Degree  of  linear  polarization  image  Jsf  +  Sf  /S0 

2.2  Visible  Imagers 

For  the  visible  face  images,  we  used  4  imagers  from  the  Basler  Scout  series  of 
progressive-scan  charge-coupled  device  (CCD)  cameras.  All  4  cameras  used  the 
Sony  ICX424  AL/AQ  sensor,  which  provides  either  grayscale  (monochrome)  or 
red-green-blue  (RGB)  Bayer  mosaic  images.  Two  models  of  Basler  cameras  were 
used  for  face  image  collection,  and  we  employed  2  cameras  of  each  model: 

1)  scA640-70gm  (monochrome) 

•  Sensor  size:  659  x  494  pixel  images 

•  Optical  size:  1/3  inch 

•  Pixel  size:  7.4  pm  x  7.4  pm 

•  Maximum  frame  rate:  70  fps 

2)  scA640-70gc  (RGB  color) 

•  Sensor  size:  658  x  492  pixel  images 

•  Optical  size:  1/3  inch 

•  Pixel  size:  7.4  pm  x  7.4  pm 

•  Maximum  frame  rate:  70  fps 

Using  4  cameras  with  virtually  identical  imaging  and  data  properties  allowed  us  to 
collect  images  of  the  same  face  at  4  different  resolutions  simultaneously  by  using 
objective  lenses  with  4  different  focal  lengths.  The  configuration  of  the  cameras  is 
shown  in  Table  2. 

Table  2  Camera  configurations 


Camera 

Type 

Objective  FL 
(mm) 

FOV 

O 

scA640-70gc 

RGB  color 

50 

5 

scA640-70gm 

Monochrome 

16 

17 

scA640-70gc 

RGB  color 

8 

34 

scA640-70gm 

Monochrome 

4.5 

53 
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The  50-mm  lens  provided  the  greatest  number  of  pixels  between  the  eyes  and 
the  4.5-mm  lens  the  least  number  of  pixels  between  the  eyes  for  the  same  face. 

2.3  Uncooled  Thermal  IR  Imager 

An  uncooled  thermal  imager,  the  FLIR  SC660,  provided  broadband  unpolarized 
thermal  face  images  for  this  study.  The  sensor  size  in  pixels,  640  x  480,  was  similar 
to  the  polarimetric  VELA  sensor  and  the  Basler  Scout  CCD  cameras  for 
comparison. 

The  basic  specifications  for  the  FLIR  SC660  used  in  this  study  were  as  follows: 

•  FOV:  24°  x  18° 

•  Spatial  resolution:  0.65  mRad 

•  Thermal  sensitivity:  30  mK  at  30  °C 

•  IR  resolution:  640  x  480  pixels 

•  Spectral  range:  7.5-13  pm 

•  Analog  image  output:  NTSC  analog  video 

•  Digital  image  output:  Firewire  radiometric,  14-bit  digital  video  to  PC 

The  analog  video  was  not  used  for  this  study.  The  radiometric,  14-bit  digital  data 
provided  temperature  measurement  information  for  comparison  with  the 
polarimetric  VELA  sensor. 

2.4  Sensor  Platform 

The  sensors  were  mounted  to  a  single  optical  plate  as  shown  in  Fig.  3.  The  VELA 
polarimetric  IR  sensor  is  indicated  by  the  red  rectangle,  the  4  Basler  CCD  visible 
cameras  are  indicated  by  the  white  rectangle,  and  the  FLIR  uncooled  IR  sensor  is 
indicated  by  the  yellow  rectangle.  The  optical  plate  was  mounted  to  a  heavy  duty 
QuickSet  Gibraltar  geared  pan-tilt  head;  the  Gibraltar  tripod  as  shown  in  Fig.4.  This 
setup  provided  a  very  stable  platform  for  the  image  collection. 
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Fig.  3  Polarimetric  VELA  sensor  (red),  Easier  CCD  cameras  (white),  and  FLIR  660 
camera  (yellow) 


Fig.  4  Gibraltar  pan-tilt  head 
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2.5  Sensor  Calibration 


The  FLIR  SC660  IR  camera  is  factory  calibrated  for  accurate  temperature 
measurements  and  thermal  imaging.  The  FLIR  SC660  used  in  this  study  was  sent 
to  the  factory  for  an  inspection  and  calibration  to  maintain  its  accuracy  in  data 
collection.  No  user  calibration  procedures  were  necessary  for  the  FLIR  SC660 
during  the  face  image  collection. 


The  VELA  LW  sensor  requires  a  polarimetric  calibration  and  a  radiometric  non¬ 
uniformity  correction  (NUC).  For  the  polarimetric  calibration,  a  calibration 
polarizer  consisting  of  a  wire  grid  polarizer  on  a  barium  fluoride  substrate  and  2 
blackbody  sources  are  used.  During  the  extent  of  the  face  image  collection,  we  used 
premeasured  polarimetric  calibration  files.  No  polarimetric  calibrations 
measurements  were  taken  during  the  test.  For  the  radiometric  NUC,  we  positioned 
a  blackbody  source  (Fig.  5)  at  a  stable  temperature  in  front  of  the  objective  lens. 
The  NUC  measurements  consist  in  collecting  uniform  image  frames  at  several 
reference  temperatures.  For  the  face  image  collection,  we  employed  a  Mikron 
M345  as  our  blackbody  calibration  source  and  performed  a  2-point  NUC  at  20  °C 
and  then  at  40°C. 


Fig.  5  Mikron  M345  blackbody  source  positioned  in  front  of  VELA  objective  sense 
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3.  Data  Acquisition 


3.1  Imaging  Polarimeter  Data  Acquisition 

The  VELA  LW  imaging  polarimeter  had  a  gigabit  Ethernet  (GigE)  port  for  data 
output.  To  record  the  data,  we  used  the  Grave  Control  software  developed  by 
Polaris  Sensor  Technologies.  We  used  the  software  to  adjust  the  focus  on  each 
subject  and  set  the  following  parameters: 


Number  of  frames  to  collect: 

500 

Number  of  frames  per  second: 

60 

Rotation  rate  of  the  )J2  retarder: 

60  Hz 

Camera  lens: 

wide  FOV 

3.2  Uncooled  Thermal  IR  Imager  Data  Acquisition 

The  FLIR  SC660  had  an  IEEE  1394a  (Firewire  400)  port  for  output  of  image  data. 
To  record  the  data,  we  used  the  Research  IR  software  from  FLIR,  Inc.  We  generally 
used  the  autofocus  on  the  FLIR  SC660  camera  to  set  the  focus,  and  then  verified 
the  focus  using  the  Research  IR  software.  We  used  the  software  to  acquire  sequence 
of  images  for  10  s  at  30  fps. 


3.3  Visible  Imager  Data  Acquisition 


The  4  Basler  Scout  CCD  cameras  had  GigE  ports  for  data  output.  To  record  the 
data,  we  used  a  custom  configured  Quazar  video  recording  and  processing  platform 
from  Boulder  Imaging,  Inc.  The  Quazar  had  4  GigE  ports  capable  of  recording  4 
data  streams  simultaneously.  We  recorded  each  video  stream  to  a  separate  internal 
disk  for  maximum  system  throughput.  We  used  the  Quazar  software  and  set  up  files 
to  set  the  following  parameters: 


Elapsed  time: 
Frames  per  second: 
File  option: 

Image  type: 

Image  size: 

Image  bit  depth: 


10  s 
70 

TIFF 

Bayer  RGB  (color),  mono 

640  x  492  (color),  640  x  480  (mono) 

8  bits/pixel 
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4.  Institution  Review  Board  Process 


Because  the  face  image  collection  involved  human  subjects,  we  needed  to  obtain 
approval  from  the  US  Army  Research  Laboratory  (ARL)  Institutional  Review 
Board  (IRB)  before  collecting  face  images.  To  obtain  the  approval,  the  investigators 
needed  to  do  the  following: 

1)  Take  an  online  course  from  the  Collaborative  Institutional  Training 
Initiative  (CITI)  and  pass  the  online  test.  In  addition,  the  investigators 
needed  to  take  periodic  refresher  courses  and  pass  additional  online  tests. 

2)  Submit  the  research  protocol.  This  protocol  provides  an  abstract,  the 
location  of  the  research,  the  data  collection  dates,  background  information, 
and  the  research  objective.  In  addition,  there  is  a  description  of  the 
equipment  and  facilities.  The  protocol  needs  to  provide  the  number  subjects 
planned,  a  justification  for  the  sample  size,  whether  there  is  compensation 
for  subjects,  and  the  methods  of  subject  recruitment.  The  protocol  must 
include  the  data  collection  procedures,  the  experimental  design,  and  the 
planned  data  analysis.  An  important  part  of  the  protocol  is  the  identification 
of  risks  and  discomforts  to  the  subjects,  and  the  plan  to  mitigate  the  risks 
and  discomforts.  The  protocol  must  address  confidentiality  issues  and  the 
methods  we  will  use  to  maintain  the  privacy  of  the  subjects. 

3)  Submit  a  copy  of  the  consent  form  that  the  subjects  of  the  study  would  be 
required  to  sign. 

4)  Submit  technical  reviews  of  the  research  protocol  by  at  least  3  “individuals 
qualified  by  training  and  experience  to  evaluate  the  validity  of  the  project”. 

The  IRB  provided  feedback  to  the  investigators.  The  feedback  resulted  in  additional 
work  on  the  protocol  and  consent  form  before  the  IRB  granted  approval. 

Our  face  data  collection  did  not  fit  into  the  usual  parameters  of  human  subject 
research  that  was  familiar  to  the  IRB  and  the  Human  Research  and  Engineering 
Directorate  of  ARL.  The  sample  files  and  templates  provided  by  the  IRB  generally 
presumed  that  humans  subjects  would  be  asked  to  perform  tasks  while  subjected  to 
various  stimuli  and  it  was  the  subject’s  performance  that  being  tested  or  evaluated. 
We  did  ask  the  subjects  to  perform  a  few  tasks,  but  these  were  to  cause  the  subjects 
to  vary  their  facial  pose  or  expression.  We  were  not  evaluating  the  subject’s 
performance.  For  this  reason,  there  was  “learning  curve”  for  the  face  recognition 
researchers  and  the  IRB.  Our  face  data  collection  also  not  fit  into  the  standard 
practices  covered  in  the  CITI  training.  The  CITI  training  primarily  targeted  social 
and  behavioral  research  investigators. 
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5.  Experimental  Setup 


For  the  initial  phase  of  our  study,  we  collected  the  face  images  indoors.  The  sensors 
were  mounted  as  shown  in  Fig.  4.  For  the  duration  of  the  data  collection,  the  sensor 
tripod  was  stationary  and  the  subjects  moved  to  provide  different  distances  to  the 
sensors.  The  sensor  platform  could  pan  in  azimuth  and  tilt  in  elevation  several 
degrees  to  adjust  for  the  different  heights  of  various  subjects. 


The  subjects  were  seated  a  nonrotating  chair  (shown  Fig.  3).  Directly  behind  the 
chair  was  rectangular  piece  of  “sound-soak”  wall  material  to  serve  as  uniform 
background  in  the  visible  and  IR.  Located  2  m  in  front  of  the  chair  was  a  flood  lamp 
(Fig.  6)  with  a  compact  fluorescent  bulb.  For  our  study,  we  used  Ecosmart  compact 
fluorescent  “daylight”  23-W  bulb,  with  a  brightness  of  1,550  lumens  and  a  color 
temperature  of  5,000  K. 


Fig.  6  Subject’s  chair  with  flood  lamp  and  background  board 
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We  used  the  flood  lamp  in  order  to  increase  illumination  on  the  face  for  the  visible 
sensors  and  minimize  differences  in  facial  illumination  that  occurs  when  the  chair 
is  moved  to  different  distances  from  the  sensors  and  the  overhead  or  surrounding 
lighting  changes. 

Attached  to  the  background  board  were  positional  markers  for  the  visible  and  IR 
sensors  (Fig.  7).  These  are  used  for  registering  the  thermal  and  visible  images. 
These  markers  were  constructed  of  common  cellulose  sponge  material.  When  the 
sponges  were  filled  with  water,  they  would  appear  as  persistent  “dark”  spots  in  the 
thermal  images  and  were  also  highly  visible  to  the  other  cameras. 


Fig.  7  Thermal  and  visible  registration  makers 

The  setup  of  the  flood  lamp,  chair,  and  background  board  were  moved  together  in 
order  to  change  the  distance  from  the  sensors  to  the  seated  subject.  The  distances 
used  for  our  study  were  as  follow: 


R5: 

12.5  m 

R4: 

10.0  m 

R3: 

7.5  m 

R2: 

5.0  m 

Rl: 

2.5  m 
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6.  Experimental  Procedure 


For  each  subject,  we  followed  this  experimental  procedure: 

1)  The  subjects  arrived  at  the  image  collection  site  at  a  scheduled  time. 

2)  They  were  given  an  overview  of  the  study  and  allowed  to  read  the  consent 
form  and  the  face  image  release  form.  Subjects  were  not  asked  to  disclose 
age,  gender,  or  other  demographic  information. 

3)  If  the  subjects  signed  the  consent  form  and  the  face  image  release  form,  they 
were  shown  to  chair  at  the  first  marked  distance. 

4)  If  they  were  wearing  glasses,  they  were  asked  to  remove  them,  because 
glasses  are  opaque  in  the  IR  band.  Subjects  were  not  asked  to  remove 
makeup  or  sunscreen. 

5)  The  subjects  were  asked  to  face  forward  and  sit  still  while  images  were 
being  collected  by  the  sensors.  This  was  referred  to  as  the  “baseline”  image 
sequence. 

6)  We  asked  the  subjects  to  turn  their  heads  from  far  left  to  far  right  over  a 
span  of  8  s  while  the  sensors  were  collecting  data.  This  was  referred  to  as 
the  “pose”  image  sequence.  This  sequence  contained  multiple  face  pose 
angles  from  approximately  -90°  to  +90°,  as  shown  in  Fig.  8. 


1)  Start  position 
-90° 


Fig.  8  Geometry  of  the  “pose”  image  sequence 

7)  The  subjects  were  then  asked  to  face  the  cameras  and  count  numbers  out 
loud  starting  from  “1, 2,  3,..”  for  10  s  while  the  sensors  were  collecting  data. 
This  sequence  was  referred  to  as  the  “expression”  image  sequence. 
Requiring  the  subject  to  count  aloud  resulted  in  different  facial  expressions 
on  the  subject’s  face  while  speaking  the  different  numbers. 
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8)  We  would  then  move  the  chair  and  associated  equipment  to  the  next  marked 
distance.  We  would  ask  the  subjects  to  repeat  the  “baseline”,  “pose”,  and 
“expression”  sequence  at  the  new  distance.  We  would  continue  this  process 
until  we  had  collected  image  data  at  5  marked  distances:  2.5,  5,  7.5,  10,  and 
12.5  m. 

7.  Experimental  Data 

We  collected  face  data  on  50  subjects  during  the  period  from  August  to  December 
2014.  These  subjects  were  employees  or  contractors  of  the  US  Army  Garrison 
Adelphi  Laboratory  Center,  Adelphi,  Maryland.  There  were  38  males  and  12 
females.  We  did  not  record  the  age,  race,  or  ethnicity  of  the  subjects,  but  all  were 
at  least  18  years  of  age  or  greater.  Several  researchers  in  the  field  of  cross-spectral 
face  recognition  have  used  50  subjects  for  their  studies.  Fifty  subjects  were  used 
for  a  visible  and  MWIR  study.7  The  West  Virginia  University  Multi-spectral 
database  consists  of  visible  and  shortwave  IR  face  images  of  50  subjects.8  In  2012, 
researchers  at  Night  Vision  and  Electronic  Sensors  Directorate,  in  their  study 
“Thermal  to  Visible  Facial  Recognition  Data  Collection,”  used  50  subjects.9 

Figures  9  through  12  show  the  image  data  produced  by  the  VELA  polarimetric  IR 
hardware  and  the  data  collection  software. 


Fig.  9  VELA  polarimetric  So  image 
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Fig.  10  VELA  polarimetric  Si  image 


Fig.  11  VELA  polarimetric  S2  image 


Fig.  12  VELA  polarimetric  DOLP  image 

Figure  9,  the  VELA  So  “total  reflectance”  image,  closely  resembles  the  images 
produced  by  the  broadband  unpolarized  FLIR  SC660  as  would  be  expected.  The 
VELA  So  image  generally  showed  greater  thermal  detail  than  the  FLIR  SC660 
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given  that  the  sensor  had  a  better  thermal  sensitivity  and  a  smaller  FOV.  Figures  10 
through  12,  the  Si,  S2,  and  DOLP  images,  show  more  shading  and  stronger  edge 
information  related  the  surface  geometry  of  the  face  than  traditional  thermal 
images. 

Figure  13  shows  an  image  produced  by  the  uncooled  thermal  IR  imager,  the  FLIR 
SC660.  The  thermal  markers  shown  in  Fig.  7  are  plainly  visible  as  4  dark  spots  on 
the  board  behind  the  subject. 


Fig.  13  FLIR  SC600  image,  25°  FOV 

Figure  14  show  the  images  produced  by  the  Basler  Scout  “visible  light”  cameras. 
These  imagers  had  5°,  17°,  34°,  and  53°  FOVs,  respectively.  Opto-mechanical 
issues  with  the  8-  and  4.5-mm  objective  lenses  prevented  the  imagers  with  34°  and 
53°  FOVs  from  forming  completely  in-focus  images. 
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Fig.  14  Images  from  the  Easier  Scout  cameras:  5°,  17°,  34°,  and  53°  FOVs 

8.  Conclusion 


The  face  images  collected  by  the  polarimetric  thermal  IR  imager  and  visible  light 
cameras  have  already  found  useful  applications. 

Alex  J  Yuffa,  Kristan  P  Gurton,  and  Gorden  Videen,  of  ARL’s  Computational  and 
Information  Science  Directorate  have  used  the  Stokes  images  So,  Si,  S2,  and  DOLP 
image  to  generate  3-D  face  images.  They  used  the  Fresnel  relations  to  determine 
the  surface  normal  at  each  pixel  and  integrated  over  the  surface  normals  to  obtain 
a  3-D  face  image.10 

Shuowen  Hu  of  ARL  and  Nathaniel  Short  of  Booz  Allen  Hamilton  used  the 
polarimetric  and  visible  faces  images  obtained  from  the  50  subjects  to  improve  the 
thermal-to-visible,  cross-modal  face  recognition  accuracy  by  more  than  20%  versus 
using  conventional  thermal  imagery  alone.11 

A  subset  of  the  collection  database  is  now  releasable  to  researchers  outside  of  ARL 
for  face  recognition  research.  There  are  relatively  few  thermal  polarimetric  and 
visible  face  image  datasets  currently  available  to  researchers.  This  Multi- Spectrum 
Face  Dataset  is  intended  to  promote  research  on  polarimetric  and  multi-spectrum 
face  recognition.  We  hope  that  this  database  will  enable  the  development  of 
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improved  thermal-to-visible  face  recognition.  We  are  currently  announcing  the  data 
set  in  various  face  recognition  research  forums. 
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List  of  Symbols,  Abbreviations,  and  Acronyms 


3-D 

3 -dimensional 

ARL 

US  Army  Research  Laboratory 

CCD 

charge-coupled  device 

CITI 

Collaborative  Institutional  Training  Initiative 

DOLP 

degree  of  linear  polarization 

FOV 

field  of  view 

FPA 

focal-plane  array 

GigE 

gigabit  Ethernet 

IR 

infrared 

IRB 

Institutional  Review  Board 

LHC 

left-hand  circular 

LWIR 

longwave  infrared 

MWIR 

midwave  infrared 

NUC 

non-uniformity  correction 

PC 

personal  computer 

RGB 

red-green-blue 

RHC 

right-hand  circular 
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